Classical and Quantum Fluctuation Theorems for Heat Exchange 
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The statistics of heat exchange between two classical or quantum finite systems initially prepared 
at different temperatures are shown to obey a fluctuation theorem. 
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The fluctuation theorem _(FT)refers to a collection of 
theoretical predictions El H El HI IS j recently con- 
firmed experimentally pertaining to a system evolv- 
ing under non-equilibrium conditions. These results are 
roughly summarized by the equation 



In 



p(-s) 



(1) 



where p{T) denotes the probability that an amount of 
entropy X is generated during a specified time interval. 
Both transient and steady state versions of the FT have 
been obtained. The definition of "entropy generated" (£) 
depends on the dynamics used to model the evolution of 
the system under consideration. However, for a variety 
of physical situations, and a variety of equations of mo- 
tion (both deterministic and stochastic) used to model 
them, the FT has been established under reasonable def- 
initions of entropy generation. Moreover, the FT is re- 
lated to a set of free energy relations (see e.g. (lcHlH) 
which connect equilibrium free energy differences to non- 
equilibrium work values, and which have recently been 
confirmed experimentally |l2| . 

The situations modeled in Refs. [1 E H II IS IS II 
IS IS Hoi Hl| all involve an externally driven system, in 
the presence of a heat reservoir. The purpose of this pa- 
per is to point out that a similar result can be derived 
in a different setting. Namely, we will obtain a symme- 
try relation constraining the statistics of heat exchange 
between two bodies initially prepared at different tem- 
peratures. We will present both classical and quantum 
derivations, and will use the term exchange fluctuation 
theorem (XFT) to refer to these results. 

In what follows, the XFT (Eq. ©) will be stated and 
derived. A corollary result related to the Second Law of 
Thermodynamics will then be presented (Eq. (T7J|). 

Consider two finite bodies, A and B, separately pre- 
pared in equilibrium states at temperatures Ta and Tg, 
respectively, then placed in thermal contact with one an- 
other for a time r, and then separated again. Let Q 
denote the net heat transfer from A to B during the in- 



terval of contact, i.e. the amount of energy lost by A 
and gained by B. Now imagine repeating this experi- 
ment many times, always initializing the two bodies at 
the specified temperatures, and let p T {Q) denote the ob- 
served distribution of values of Q over the ensemble of 
repetitions. Then we claim that this distribution satis- 
fies 
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Pr( + Q) 
Pr(-Q) 



A0-Q, 



(2) 



where A(3 = Tg l — T^ 1 is the difference between the 
inverse temperatures at which the bodies are prepared. 

In the quantum case we must define Q through an 
experimental procedure: starting with the two systems 
initially prepared at different temperatures, we first mea- 
sure the energy of each system, then we allow them to 
weakly interact over a time t, and finally we again mea- 
sure the energy of each system. We then interpret heat 
transfer in terms of the changes in these measured ener- 
gies (Eq. (I14|l ). This approach is similar in spirit to that 
taken by |l3l Hil llij. who considered related problems. 
For an alternative approach see e.g. [lfj| . 

Eq. J3J clearly resembles the usual FT, Eq. QJ. Indeed, 
if we invoke macroscopic thermodynamics to argue that 
—Q/Ta is the entropy change of A, and +Q/Tb is that 
of B, then the net entropy generated by the exchange 
of heat is given by X = A/3 ■ Q, and Eq. (J2J) becomes 
Eq. However, this argument works only if the heat 
transferred is very small in comparison with the internal 
energy of either body, whereas the validity of Eq. 
does not require this assumption. Therefore, we will leave 
Eq. J5J as a statistical statement about heat exchange, 
rather than trying to force it to be a statement about 
entropy generation per se. 

To derive Eq. J5J from classical equations of motion, 
let za denote the phase space coordinates specifying the 
microstate of body A (e.g. the positions and momenta of 
all its degrees of freedom); and let H (za) be a Hamil- 
tonian whose value defines the internal energy of A, as 
a function of its microstate. Similarly for H b (zb)- Let 
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h lnt (z A , ■lb) denote a small interaction term, turned "on" 
at t = 0, and "off" at t = t, coupling the two bodies. Let 
y = (z A ,zg) specify a point in the full phase space of all 
participating degrees of freedom. During any realization 
of the process in which we are interested, the microscopic 
evolution of the two bodies is described by a trajectory 
y(i), evolving from t = to t = r under Hamilton's 
equations, as derived from the Hamiltonian 



H(y)=H A (z A ) + H B (z B ) + h int (y). 
We now further assume time-reversal invariance: 

fl*(z,) = jrfot), ^ int (y) = ^ int (y*), 



(3) 



(4) 



where i = A, B and the asterisk (*) denotes the time- 
reversal operation, usually the reversal of momenta: 
(l)P)* = (Qi — P)- This assumption has the crucial 
consequence that microscopic realizations of the process 
come in pairs related by time-reversal: for any trajectory 
y(t) which is a solution of Hamilton's equations, its time- 
reversed twin, y(t) — y*(r — t), is also a solution. For 
future reference let y° and y T denote the initial and final 
conditions of the "forward" realization 0], y(t); hence 
the "reverse" realization, y(t) , evolves from y° = y r * to 
y T = y°* , as illustrated in Figure Q 
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FIG. 1: Twin trajectories y(t) and y(t) 
time reversal. 



y*(r — t) related by 



By our assumption regarding the equilibrium prepara- 
tion of the two bodies, the probability distribution for 
sampling initial conditions y° is given by: 



P(y°) = 



ZaZb 



_ e -H A (z° A )/T Ae -H B (z B )/T B 



(5) 



where the Z's are partition functions. Given a trajectory 
y(t) and its time-reversed twin y(t), the ratio of prob- 
abilities of sampling their respective initial conditions is 
then: 



P(y°) 
P(y°) 



e AE B /T Be AE A /T A 



(6) 



where AE A = H A (z T A ) - H A (z° A ) = H A {z A ) - H A (z° A ), 
and similarly for AEb- The quantities AE A and AEb 



represent the net change in the internal energies of the 
two bodies, over the course of the realization described by 
y(t). If we neglect the small amount of work performed 
in switching on and off the interaction term h lnt , then the 
net change in the energy of one system is compensated 
by an opposite change in the energy of the other, i. e. 
AEb ~ ~AE A , and it is natural to view these changes 
as representing a quantity of heat transfered from A to 
B: Q := AE B « -AE A - Hence, 



P(fl_ e W-Q(y°) 
Pit) 



(7) 



where the function Q(y) denotes the value of Q during a 
realization evolving from initial conditions y. Note that 



Q(y°) = -Q(y°) 



(8) 



that is, the heat transfer during the forward realization 
is opposite to that during the reverse realization. 
Combining Eqs. J7J) and (JSJ we get: 

PAQ) = f dy°P(y°)6[Q-Q(y )] 

o A0-Q I d ^o p{ -0 )s[Q + Q (j O )] 



(9) 



which is equivalent to Eq. @. Here the change in the 
variables of integration between the first and second lines 
is justified by the invariance of the Liouville measure un- 
der time evolution (dy° = dy T ), as well as under time 
reversal (dy T = dy T * = dy°). 

These formal manipulations can be understood intu- 
itively. p T (Q) is a sum of contributions from all real- 
izations for which the heat transfer takes on a specified 
value, Q] and p T (— Q) is a sum over those for which the 
heat transfer is — Q. But these two sets of realizations are 
in one-to-one correspondence; for every trajectory y(t) 
belonging to the former set, its twin y(t) belongs to the 
latter (Eq. |SJ). Moreover, the ratio of initial condition 
sampling probabilities for such a twinned pair of realiza- 
tions is e A/3 < 3 (Eq. Q). Therefore, when we add the 
sampling probabilities P(y a ) from the first set of realiza- 
tions to get p T (Q), and P(y°) from the second set to get 
Pt{—Q), the ratio of the sums is e A ^' Q . 

The above derivation, based on comparing the sam- 
pling probabilities for pairs of twinned trajectories, is 
similar to that carried out by Evans and Searles 0] for the 
transient FT. Note also that this derivation is valid for 
arbitrary times r; there are no hidden assumptions that 
the temperatures of the two systems remain constant, or 
even well-defined after t = 0. 

The sole approximation that we have made is the ne- 
glect of the interaction term, h mt . In reality, a finite 
amount of work is required to turn on this interaction 
initially, 5w OIl , and then to turn it off finally, Sw ff. 
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The resulting balance of energy reads: AEa + AEb = 
Sw on + 8w g, hence Sw = Sw on + Sw g enters as a cor- 
rection to the approximation AEb ~ —AEa used ear- 
lier. The validity of our final result thus requires that 
the work performed in coupling and later uncoupling the 
systems (\Sw\) be much smaller than the typical energy 
change in either system (\AEa\, \AEb\). Whether or 
not this condition is met depends, of course, on details of 
the two systems, on the strength of the interaction term 
(Sw ~ h mt ), and on the duration r. It will be interesting 
to investigate this issue in the context of specific models. 

We proceed now to the proof of the quantum ver- 
sion of our theorem. We assume that systems A and 
B have equilibrated to temperatures Ta,Tb before the 
experiment, and are thus described by density matrices 
Pi = cxp(—(3iH' l )/Zi, where i — A,B. At time t = 0~ 
we separate the systems from the reservoirs and measure 
their energies. As a result, each system % is projected 
onto a pure state |nj) with probability e~ l3 ' En i /Zi, and 
the combined system is described by the product state 
\n>AnB)- We then allow the systems to interact through 
a weak coupling term h lnt . Thus the Hamiltonian takes 
the form H = H A ® I B + I A <g> H B + h int . 

Let us now assume, as in the classical case (Eq. (@J), 
that the system and both its subsystems are time-reversal 
invariant. In quantum mechanics the time-reversal in- 
variance of a system is expressed by the condition 



QH = HQ, 



(10) 



where H is the system Hamiltonian, and is the quan- 
tum time- reversal operator 0, 0|. This operator re- 
verses linear and angular momentum while keeping posi- 
tion unchanged, and is anti-linear. 

e(ai\ip)+a 2 \<t>)) =a\&\iP) +al®\<p), (11) 

where the dagger denotes complex conjugation. When 
dealing with such operators, the Dirac bra-ket notation, 
invented to deal with linear operators, becomes cumber- 
some: the expression (4>\0\ip) is ambiguous until we spec- 
ify whether is acting to the right or to the left. To avoid 
this inconvenience we will use the standard product in 
Hilbert space (|0), \ip)), rather than the more abbreviated 
Dirac bra-ket, (4>\ip), to denote the inner product between 
two wave functions. From Eq. IjlOjl it follows that, for ev- 
ery eigenstate \n) of H there corresponds a time- reversed 
eigenstate &\n) with the same energy; these two states 
are either linearly independent, or else identical apart 
from an overall phase. Moreover, since preserves wave 
function normalization, it is not just anti-linear but also 
anti-unitary: (0|0), 0|^)) = (|V>), !</>))■ We will make use 
of these properties in the analysis below. 

Having turned on the interaction term at t — 0, we 
allow the systems to evolve for a time r. The combined 
system then reaches a state |^), obtained from the initial 



state \niAnB) by evolution under Schrodinger's equation. 
We now separate the two systems - that is, we turn off 
the interaction term - and once again measure their en- 
ergies. The state is thus projected onto a product 
state Im^ms)- As before, we make no assumptions re- 
garding r, in particular the systems have not necessarily 
equilibrated. 

Letting P T (\n) — » \m)) denote the probability of ob- 
serving a transition from \n) = \nAns) to \m) = 
ImATOs), we have 



P T (\n)^\m)) = \(\m),U T \n)t 



ZaZb 



where U T — e~ tT ' H is the quantum evolution operator, 
and h = 1. The second factor on the right is the prob- 
ability for sampling the initial state |n); the first factor 
is the transition probability from \n) to \m). Similarly, 
the probability of observing the time-reversed transition 
from 0|m) to 0|n) is 



P r (0|m) - 0|n» = |(0|n),/7 T 0|m))| 5 



-PaE*-P b E* 



ZaZb 



But, since is anti-unitary, and U T <d — OU- T |2fJ, we 
have 

(Q\n),U T e\m)) = (0|n),0f/_ T |m)) = (C/_ T |m),|n)) 
= (\m),U r \n)), 

therefore 

P T (\n) -> \m)) = -i3 A (E* A -Et A ) e -p B (EZ B -E* B ) 
P T (Q\m) -► 0|n)) ' ' 

(12) 

Since we assumed that the interaction is weak, we expect 
the energy of the total system to be almost preserved: 



+ ~ ti m + E m . 



(13) 



It follows that the energy changes in the two systems are 
approximately equal 



An - ti n ~ E n - E m . 



(14) 



We interpret Q as the heat exchange between the systems 
A and B. Thus, 



P T (\n) -> |m)) _ a/3-q„_ 
P T (Q\m) -» e\n)) ~ 



(15) 



Since every eigenstate has a corresponding time-reversed 
twin, the net probability of the heat transfer Q in time 
r is 

Pr(Q) = 5^JV(|n> -» \m))S(Q-Q 

n — >m J 

= e^' Q Pr(e\m) ^Q\n))S(Q + Q 0m ^0n) 

On,Om 

= e A ^p T (-Q). (16) 



4 



This result is true for the quantities as we have defined 
them. We can rewrite Eq. (|16fl in the form of Eq. (J2J) if 
we further assume a sufficiently dense spectrum, so that 
Pt{Q) can be replaced by a locally smooth function. 

At the level of macroscopic thermodynamics (and in 
the absence of external work), the passage of heat from 
a colder to a hotter body constitutes a violation of the 
Second Law. From Eq. (J2J), we can derive an upper bound 
on the probability of observing such a "violation" , of at 
least some finite magnitude, as follows. Assume that 
T A > T B , i.e. A/3 > 0. The probability that the heat 
transfer from A to B will fall below a specified value q is 
given by f^ OQ Pr(Q)dQ. Using Eq. J2J to replace p T (Q) 
by p T {—Q) exp(A/3 ■ Q), and then invoking the inequality 
chain 

f Pri-Q^ QdQ < e A ^ f p T (-Q)dQ < e A ^, 

J — oo J — oo 

we get 

f 9 p T {Q)dQ<e A ^. (17) 

J — oo 

Choosing q < 0, this result tells us that the probabil- 
ity of observing a net heat transfer in the "wrong" di- 
rection (Q < 0), from B (cold) to A (hot), of at least 
some magnitude \q\, dies exponentially (or faster) with 
that magnitude. Eq. J5J also implies that the average of 
exp(— A/3 • Q), over the ensemble of realizations for any 
time r, is unity: 

e-WQ = J dQp T {Q)e- Ap Q = 1. (18) 

In conclusion, a result analogous to the FT for entropy 
generation (Eq. JQl), and valid for arbitrary times r, has 
been derived for the statistics of heat exchange between 
finite classical or quantum systems separately prepared 
in equilibrium (Eqs. J3J0- I n our derivation we invoke 
statistical mechanics to describe the initial preparation 
of the systems, then treat their evolution during the in- 
terval of contact dynamically. We also assume a negligi- 
ble energy of interaction between the two systems, and 
a time-reversal invariant Hamiltonian. In the quantum 
case, an additional source of randomness arises from the 
fact that the initial quantum state of the system does not 
uniquely determine the outcome of the final energy mea- 
surements. Nevertheless, this does not spoil our result. 



We finally mention that a similar theorem can be derived 
for particle exchange between two reservoirs, driven by a 
difference in initial chemical potentials (unpublished). 
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